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This paper describes selected nonschool uses of simulation and discusses the 
implications of each application for education in general. Most of the applications 
described pertain to instruction and include the provision of an environment for 
exercising or practicing the application of principles or skills. Applications which are 
examined include (1) the use by the military of various simulator trainers, 
auto-instructional simulators, the Pocket Blinker and a War Wouhd Moulage Kit; (2) the 
use by the government of simulation planning exerdses: and (3) the use by industry of 
business and management simulation games. An experiment with television-mediated 
simulation by a Boston UHF channel and the use of simulation in situational response 
testing by the American Board of Orthopaedic Surgery are also reviewed. Discussion 
of the implications from these applications for education indudes analysis of the 
factors of cost of the simulation, complexity, realism, uses, and value. Forty-seven 
references are listed. Appended is a representative listing of X’ses of Instructional 
Simulation Systems in Industry, Government, the Military, and Other Non-School Uses"; 
information on each of the 4o items indudes the name of the simulation, the designer, 
the target group, and a brief description. (JS) 
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A function of the increasingly complex technological world In 
whldi we live has been the requirement for better learning systems — 
systems where the student is actively Involved In the learning process. 
Such an enviroTMnent Is learner-centered rather than Instructor-centered. 
In this context, it Is significant that simulation be explored at this 
conference. With the advent of simulation, the oft-quoted axiom that 
learners should participate actively In instruction Is given meaning 
and substance. 

Th«» purpose of this oaoer Is to exciuilo.c selected non— school uses of 
simulation. Throughout the paper. Implications from these applications 
for education in general will be pointed out. These Implications 
Involve such factors as: (1) cost of the simulation, (2) complexity, 

(3) realism, (4) what Is simulated, end (5) Its uses and value. From 

this discussion, perhaps the reader will be better able to assess for 

/ 

himself the status of the field — where It has been, whqre It Is now, 

/ 

and where It might be going In the future. 
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It should be stressed that this paper In no way attempts to survey 
exhaustively the many uses of simulation In non*school settings. The 
reader Is referred to the appendix for a representative listing of 
non-school uses of simulation. 

Most of the applications discussed pertain to Instruction, and In 
particular, the provision of an environment of exercising or practicing 
the application of principles or skills. The Instructional simulation 
systems to be examined all possess the following features: 

(1) enacted or life-like responses are made to 

(2) non-real-life stimulus situations that 

(3) provide feedback to the student vis ^ vis his behavior In 
the on-golng Instructional context that 

(4) offers control (cf., Twelker, 1968). 

Simulation may be used for purposes other than Instruction. In 
particular, the use of simulation in the generation of new systems or 
programs Is Important. The developmental use will be explored In the 
section on governmental applications. 

Military Applications 

Simulator Trainers 

In the military, the word "simulator" is commonly associated with 
equipment. Often, these "machine-ascendent" simulators require a team 
of operators rather than just one, and are called "systems simulators.' 
Many are multimillion dollar devices, and arc mediated by an electronic 
computer. Some have cstlnatedthat there are over 3,000 different 
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types of simulators used currently by the military and coianerclal 
aviation. Expenditures on prototype simulation devices are set minimally 
at $27 million annually. Listed below are several names of simulators 
that serve to Illustrate the variety of training functions served by 

simulation. 

Simulator, Small Arms, Flash Noise 

Shipboard Universal Radar Land Mass Simulator 

Sonar Simulator 

Submarine Simulator, Universal 

Talos System Shipboard Simulation Equipment 

Target Generator, Three Dimensional, Airborne Simulator 

Helicopter Flight Simulation 

Height Finder Target Simulation 

Fire Control and Launcher Simulation 

F8U-1 Operational Flight Simulator Trainer 

The evolution of computer-mediated simulator trainers has been 
significantly speeded by groups such as NASA in its efforts to provide 
a training capability for manned space flights. Moot of these simulators 
represent a sophistication of man-machine adaptive and responsive 
environments. Kristy (1967) describes a training environment that 
staggers the imagination of those who spend most of the time in front 
of a chalkboard talking to students. The Slnutech Trainer was conceived 
of to train Air Force electronics technicians in a manner that provides 
tutorial teaching capabilities and realistic on-the-job experience. 

The specification of the system which Kristy describes calls for conq>uter— 
controlled programed learning to Integrate several types of display; 

(1) animated schematics, (2) textual and diagrammatic teaching material 
that Includes quizes and branching sequences. A hl^-speed, quick-access, 
videotaped presentation system provides informal lectures, "cookbook* 
advice, and tutorial support for the student. All this is linked with a 
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slBulatlon of an electronic ayaten vihldi Che aCudent la reaponalble 
for nalntalnlng. Thla ays tern, linked with Che conpuCer, aenaea and 
reaponds' Co Che atudenc'a maintenance acClona. Another component In 
the trainer ayatem la a almulatlon of the "operationa room" of an Air 
Force alee. Thla la accompllahed by a "aquawk box" communication tie 
betueen the operator and the maintenance room. With thla ayatem, the 
atudent: 

<1) can receive video Inatruction on fundamentala of electronlea; 

<2) can receive clarification and reinforcement from the 
computer-controlled programed Inatruction conaole; 

(3) can practice uhat he baa learned by performing "<m the job" 
by me ana of the almulated hardware; 

(4) can receive remedial help when he wlahea or when the computer 
deema It neceaaary; 

(5) can be qulsaed on hla progreaa; 

(6) can proceed at hla Individual pace; 

(7) can be monitored ao aa to Inform Inatructora of hie progreae 
and difflcultlea to examine during small, live-group aeaalons. 

From atudlea of the efficiency of computer asslated Instruction and 
almulatlon training. It la estiiaated that training time may be cut by 
two-thlrda using thla equipment. If the eystem la Implemented to 
accompUah electronics training In the Air Force, the coat would be 
about $130 million. Although this cost represents a huge sum, Kristy 
points out that If the trainers were capable of actually reducing 
training time by two-thlrda, the Air Force would save a large fraction 
of the funde expended on training, and these savings would pay for the 
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system engliieerlng» hardware development, and Installation costs of 
$130 million In only 18 months. Thereafter, the Air Force would save 

In training costs up to $75 million per year. 

Tmpllcatlons to education . The civilian application of simulator 

trainers Is discussed In detail by Kristy (1967, pp. 118-122). In 
summary, several Important points are made. 

(1) The major area of application appears to be in large federal 

training and retraining program; 

(2) On-the-job training seems necessary for retraining efforts, 

but poses serious problems; 

(3) A hlgh-ef flclency training system such as the Slmutech 
Trainer can provide simulated *'on— the— job training; 

(4) The application of the Slmutech Trainer to the federal 
programs would occur simultaneously with its application 
In Industrial training programs; 

(5) The application of the system to vocational high sdiools 
has serious problems with respect to the large capital 
Investment required. 

Regarding the last point, Kristy shot/s that the cost of training 
students In an optimal Installation In six to ten different technical areas 
might run $450 per trainee per year, figuring a 10-year period to amortize 
the capital Investment. This Is two or three times the average Investment 
|n training students. Do the benefits or potential of such devices as 
the Slmutech Trainer demand such expensive training? Is It necessary 
to build a '*slmulator-trainer-tutorlal environment” that even senses 
htnan actions to a sensitive degree and presents "diverse, alternative 
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programed situations leading to«/ard teaching and learning objectives?" 

Can we afford to lose a quarter or more of our youngsters as dropouts 
who possibly might be sufficiently motivated In such an environment 
to continue with their education? It Is estimated that "If the present 
rate of dropouts continues , there will be 32 million adults without 
high school diplomas by 1975" (Arthur D, Little « Inc. » 1968, p. 11). 

Indications are that there is rising concern over the steadily 
widening gap between the nation's manpoi'7er requirements and the capabilities 
of the available manpoi*;er pool. It has been predicted that "substantial" 
government support for manpo^^er development programs will continue. How 
much Is spent for civilian Institutional training and on-the-job training? 

It Is estimated that about $286 million for Institutional training and 
$54 million for on-the-job training la spent under funding from the 
Manpower Development Training Act of 1963 (Arthur D. Little, Inc., 

1968, p. 12). Even If the estimated $1.3 billion expenditure of Office 
of Economic Opportunity funds for equipment and materials In training 
programs are added, the total cost would hardly exceed $1.7 billion 
annually, while the training costs of the Department of Defense for 
military personnel total approximately $4 billion per year. It should 
not be necessary to say more about the comparison of where "substantial" 
support Is going! 

What does the military think about simulation? The Arthur D. 

Little, Inc. report (1968, p. 13) states that: 

"The growing emphasis on cost /effectiveness In military training 
programs will result In much greater use of simulation training. 

NTDC personnel suggest that the use of simulation Is In Its 
Infancy and that there may be almost total dependency on simula- 
tion In several training areas In the not-too-dlstant future. 

Typical areas which lend themselves to simulation techniques are 



cockpit and operational flight training » In-fllght training^ and 
training In electronic warfare and weapon systems* 

In order to teach personnel to operate In the conceptual » psycho- 
physical environments of the present and those anticipated for the 
future • new technologies are used to simulate such environments 
visually. A simulator Involves any one or a combination of the 
training environment, computing and associated simulation systems » 
and Instructor station and display systems* Electronics and 
optics represent major elements In the fabrication of a simu- 
lator* However, the market Is not limited to electronic and 
optics companies; Industrial organisations having educational 
technology capabilities should realise a considerable share of 
this market*" 

Will the military experience In simulation be translated effectively 
to the education of civilians in school settings? Few simulators have 
been used In occupational education* The factors that preclude rapid 
adoption center around three areas: 

Expense * Few schools have the capital to Invest In these complex 
simulator systems, even If It were shown that training time could 
be drastically reduced and that the system could pay for Itself 
In a reasonable period of time* It has been estimated that the 
cost to provide electronic equipment to one child per year Is 
$250 vs * $8 per year per child for texts (Arthur D* Little, Inc*, 
1968)* 

Insufficient cost/effectiveness data * This might be the najor 
problem with coDq»lex systems such as the Slmutech Trainer In 
civilian applications* The very great cost advantage where high 
efficiency training la desired and economically necessary has yet 
to be proven* 

Slowness of acceptance* Educators are a conservative lot , and the 



supposed "dehumanizing of education" poses a threat to Innovation* 






In fact, laechlne-as Cendant simulation does not dehumanize 
instruction, but places in the hands of the student a learning 
environment that Is quite similar to the operational world in 
which he will have to subsequently operate. 

The Little report indicates that it will probably take fifteen 
ysara before computer-assisted instruction is accepted and used by 
the majority of the elementary and hl^ schools in the nation. In 
1967, only three school systems were experimenting with CAl. It Is 
doubtful that machine-ascendent simulation will have an impact that 
Is greater, although this writer hopes that his pessimism Is unwarrented. 

Auto-Inatructlonal Simulators 

In the military, simulation applications range from the exceedingly 
simple to the exceedingly complex. At one end of the continuum, a 
simulator may cost as little as ten cents, while on the other and of the 
continuum, one single simulator may cost as much as $11 million. The 
Slmutech Trainer discussed above was a complex system that taught, 
among other things, the proper steps and procedurvS of trouble shooting 
(a cognitive objective) as well as how to actually carry out the task 
on the job (a cognltlve/psydiomotor objective). The former involveo 
the teaching of certain decision-making skills, discrimination skills, 
problem-solving, and so forth. The latter Involves the learner In 
using these skills on the simulated job which demanded physical mani- 
pulation. Although simulation may be used to exercise both types of 
objectives, the cost may vary tremendously. A class of auto-lnstructlonal 
devices termed Trainer-Tester Simulators that cover many subjects 
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illustrate this admirably. For illustration, a motor trouble-shootinp: 
Trainer-Tester Simulator will be examined. 

At the U. S. Army Ordinance School at the Aberdeen Proving Cround 
In Maryland, several courses require servicccien to remove, install, 
trouble-shoot and adjust six-cylinder engines. One way to accomplish 
this is to have a series of engines rigged to exhibit certain defects, 
and teach the servicemen the correct procedures to use in trouble- 
shooting and correcting the fault. Needless to say, this la expensive, 
and led Van Valkenbur^, Nooger, and Neville, Inc. to design the Trainer- 
Tester Simulator, an> auto-instructional device that uses pictorial views, 
and specially designed worksheets. The Pictorial Revie»7 sheets are used 
in conjunction with the worksheets to familiarize the trainee with the 
location of various components, to show the interrelatedness of the 
components, and to assist the trainee in determining correct procedures 
to be followed in performing the simulated tasks given in the problems. 

The Trouble Shooting and Repair Worksheet includes columns that list 
a specific problem, a symptom section, and a corrective-action section. 

The data in the symptom and corrective-action sections are concealed by 
a silver overlay which is easily ^removed by using a pencil eraser. The 
data uncovered reflects deviations from normal operation with the 
equipment operating under the indicated trouble symptom. The trainee 
must be familiar with the equipment to select those checkpoints from 
whidi he wishes to obtain data so that he may arrive at a correct solution. 
Indiscriminate erasures indicate that the trainee has analyzed the problem 
incorrectly. 

A typical trouble shooting problem for the six cylinder engine is 
given as follows: "Breaking action is poor; break pedal has a soft, 
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spongy action.” or "Engine will not start and there Is no spark at the 
spark plugs." Using the latter problem as an example, the trainee might 

reason as follows : 

"Well, It's apparent that the trouble Is electrical In nature. 

Also the fault must not be with the batteries or starting motor 
since the motor turns over. Hrjnm - let's check Figure 17 (the 
wiring diagram). Most likely, the fault Is with the spark plugs 
or the distributor. Let's start trouble-shooting at the spark 
plugs. (Trainee refers to pictorial reviews and part Identifi- 
cation sheets, and finds that spark plugs are called out by 
the symbol letters AD. He then runs doim the list of check- 
point symbols on the Trouble Sheeting Worksheet tmtll he comes 
to the letters AD and then erases the silver overlay adjacent 
to the letters and writes the number "1" In the Step column.) 

"Got a value of '0.030 end gap.' (Trainee checks normal value 
on supplementary Information sheet.) That Indicates the spark 
plugs are functlonir^j normally and that's not the cause of my 
trotible. The fault must be with the distributor." 

The trainee has just begun on his trouble-shooting mission. He 

has yet to exai-ilne the breaker points, the breaker-plate capacitor, 

distributor rotor. Ignition coll, or distributor cap. Any of these 

parts could be the cause of the trouble and has to be checked 

until the data obtained disagrees with the normal value of the part 

given on a supplementary Information sheet. By the way, when the 

student erases the silver overlay next to the distributor cap. It 

reveals the word "cracked” which Indicates that a cracked distributor 

cap Is a possible cause of the troid>le. He then moves to the corrective 

action column, specifies a part replacement and finds that the trouble 

Is corrected and the problem has been solved. 

Implication for educators . Once again, the Trainer-Tester Simulator 
represents a low cost, but highly effective technique for teaching both 
identification skills and operational procedures. Mote that these 
operations are at the cognitive level, and do not involve psychomotor 
skills per se . Of course. In the operational situation, the trouble-shooter 
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would then be required to remove engine components, replace defective 
parts, and so forth. Yet, the simulator effectively shortcuts an in- 
efficient and time-consuming trouble shooting operation If real equipment 
were Involved at early stages of Instruction. It Is Important that the 
trainee know what to trouble shoot, and In t^hat order, before he actually 
begins the messy business of removing engine components and the like. 

These skills could just as easily be performed or practiced on the job. 

This Illustrates an Important advantage of simulation: \Jhen actual 

on-the-job performance would be costly or hazardous, use simulation. 

The Trainer-Tester Simulator Is Inexpensive to produce and Is adnlrably 
suited for the educational objectives. Uhat better way x^ould there be 
to have biology students "practice" dissection before actually beginning 
the work. After reading the text, they could go through the procedure 
tising a autolnstructlonal Simulator. Or- the technique could be applied, 
to medical education, where medical students xrauld be required to 
diagnose certain problematic symptoms of a patient. This, In fact, has 
been done In the area of orthopaedic surgery, and will be discussed below. 
In summary, it would seem plausible that the application of complex 
simulator trainers will not be flooding our occupational education 
areas for some time. Yet, simpler systems such as the one described 
above, should find wide acceptance in many areas. 

The Podeet Blinker 

Lest the reader get the mistaken Idea that the lower the cost, the 
more limited the simulator, let us examine an Ingenious little device that 
costs about ten cents. It's called a pocket blinker, and certainly meets 
all of the requisites to be classified as a simulator (U.S. Naval Training 
Device Center, 1963). The device Is cardboard, and simulates the operation 
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of a ship's blinker. Two seamen, sitting across a table from each 
other, may practice sending Morse Code messages back and forth using 
two of these little devices. They are so constructed that hand pressure 
moves a sliding cardboard In and out of a slot, thus simulating the 
alternate black and white patterns emanating from a ship's blinker light. 

Implication for educators . In a remarkable way, the pocket blinker 
Illustrates the fact that simulation exercises or devices do not have 
to be expensive to be effective. As long as the educational objective 
Is consistent with the operations demanded by the exercise, low-f Idellty , 
low-cost devices are eminently satisfactory. Even If the objective for 
a seaman learning Horse Code Is to have him Identify patterns under 
Qilygygg couJitlons such ss bad weather or combat , variation In the way 
the pocket blinker Is used could provide such training. However, for 
educational objectives that simply reflect the learning of the Morse 
Code and Identifying visually Morse Code patterns, the pocket blinker 
used In the simplest circumstances Is a suitable simulation exercise. 

Low fidelity. In this case, does not sacrifice learning effectiveness 
and efficiency. Similarly, simulation exercises and devices do not 

have to be expensive In school settings. 

Unfortunately, simulation designers, for the most part, have not 
been able to specify when exact physical duplication of the real'-llfc 
gi^ruatlon Is necessary to guarantee maximum transfer In the real* life 
(operational) situation. The research literature does not have a 
precise answer to this question. Some studies on transfer of training 
show that the more similar the two situations are, the more transfer 
will occur from the first situation to the second situation. On the 
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basis of these studies* many designers are prone to develop t^at are 
called ''high-fidelity simulations," some of \dilch are so complex that 
entire teams of operators are required to monitor the experience. 

On the other hand, many studies have presented evidence to Indicate 
that for complex skills, greater transfer is produced by a systematic 
arrangement of practice than by high-fidelity physical simulation 
(Gagne, 1962; Cox, et al. , 1963; Gryde, 1966; Cranford, 1962; Smode, 

1963; Nexjton, 1959). 

War Wound Moulage Kit 

Before leaving the military applications of simulation, it would 
be well to examine one more simulation device that represents relatively 
high fidelity but low cost — the War Wound Moulage Kit (Woolley , 1956) • 
The wound moulage serves two principal purposes: (1) it enables the 

wearer to apply first-aid treatment to himself, x^itnessed by students 
for a first-hand demonstration of proper first-aid procedures, and (2) 
it enables the wearer to be placed in the field as a casualty, enabling 
students to perform first-aid measures under simulated battle conditions. 
Let us examine the latter of these two purposes. Place yourself in the 
position of a squad leader, x^alklng through the woods. It is a hot day, 
and around you is the soxmd of war - artillery, grenades, rifle fire. 
This is a full scale, simulated, battle maneuver. You hear a call for 
help. Over to the left, a man lies wounded. You rush to him, and apply 

first aid. Bleeding stops. 

The wo un d that you "treated" was simulated. Yet, the situation 
called for real-life operations that sometime could save a man’s life. 



Thfi wound wo ulffgft consists of s thin f loxlblfi • f losh"*colotsd ofvsrlsy 
which simulates as closely as possible actual wounds In pertinent 
adjacent areas of the human anatomy. Each Individual moulage Is full 
slse» depicts all of the characteristics of a wound. Including details 
such as tom flesh, broken bone, severed veins and arteries, and even 
blood flow. Bone structure and flesh are shoim In relief on the surface 
of the moulage. Each moulage Is capable of being attached to the 
appropriate area of the wearer's body, and Is readily removable without 
the use of tools. Included In the kit Is a velnous puncture moulage 
and a hypodermlc^needle Insertion moulage to train students In withdrawing 
blood and Injecting medication Into the body. The kit contains 20 
moulages, several of which are mentioned below: 

(1) Gun shot wound of the palm of the hand; 

(2) Phosphor bums of the hands; 

(3) Second and third degme bums of the forearm; 

(4) Compound fracture of the lower leg 

(5) Amputation. 

Implications for education . This particular technique of simulating 
wounds certainly should not be reserved for the military. What better 
way Is there to train students of all ages how to handle first-aid 
emergencies. This writer knows of several hospitals Whldi are using 
similar techniques to train nursing students, and has heard of the 
application for training first-aid measures for Boy Scouts. Indeed, 
this relatively low-cost, hlgh-fldcllty simulation could have application 
In such areas as police training, medical and paramedical education, 
firemen training, and the like. Again, what Is Important la not so 



much the realism of the slmulrttlon as It Is the operations that the 
student goes through In performing the simulation experience. The 
War Wound Moulage kit engages the student In performing adeqiwte first- 
aid measures under pressure, and la so designed that the transfer to 
real life Is maximal. Even blood flow must be stopped by using the 
appropriate amount of pressure at the appropriate location If the patient 

were actually wounded. 

A cursory examination of each of the four simulation applications 
described above— the simulator trainer, the loi^-cost autolnstructlonal 
simulator, the pocket blinker and the wound moulage — reveals that they 
share in comnon the feature of being medla-or machine-ascendent. This 
Is, each uses some mediating device to provide an opportunity for 
practice or exercise of various crucial skills. It goes xflthout saying 
that complex decision-making or Identification skills are probably best 
trained by exercising these behaviors In a life-like setting where 
the learner may receive Immediate feedback as to the adequacy of hie 
response. Civilian applications of medla-orlented simulation are be- 
coming increasingly famllar In higher education. An example Is found 
In the unique application of simulation In teacher education as developed 
at Teaching Research (Kersh, 1961; 1963a; 1963b; TWelker, 1967). Class- 
room simulation creates for the student teacher many of the relevant 
features of a single classroom situation called '*Mr. Lands' Sixth Grade.” 
Mr. Land la the hypothetical supervising teacher with whom the student 
teachers work during this simulated experience. A complete cumulative 
record file Is available on eadi child in addition to printed descriptions 






of the hypothetical sdiool and connnunity. The technique of filming 
the youngsters In the slraulated class so that they appear to be reacting 
to the student teacher during the sequences Is eotployed In sixty 
different problem sequences on sound, motion-picture film. In each 
case, the student teacher Is expected to react to the film as though 
he were In a real classroom* Classroom simulation Is based on the 
supposition that exposition of educational methods or principles could 
be expected to help the teadier talk about teaching, but only classroom 
experience (simulated or real) could train the beginning teacher to teach* 
It has been suggested that classroom simulation In this form helps 
students practice the discriminating of cues that signal potential 
problems that require Immediate attention, make decisions In simulated 
conditions without fear of censure or embarrassment, and to modify 
their behavior on the basis of this feedback* (Twelker, 1967)* 

Other examples of medla-orlented simulations developed for higher 
education Include Cruckshank's work In classroom simulation and Inner city 
teaching problems (Cruckshank, 1966 ), simulation of dental emergencies 
(Jarabak, 1966; Lund, 1965^ 1966), and audio simulation for counselor 
education (Bealrd and Standlsh, 1964; Bealrd, 1966)* It Is simply a 
matter of time before other applications are made In school settings of 
medla-orlented simulation to create a realistic practice setting* 

Governmental Applications 

To this point, little has been said of the application of simulation 
In settings that do not Involve Instruction* In the discussion of 
governmental applications of simulation It might be profitable to examine 
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the use of the htanan-player simulation exercise for the analysis and 
planning of complex programs or systems. 

Planning Exercises 

Typically, the planning of programs that involve complex situations 
where numerous points of view may be brought to bear takes place in 
rather sterile environments that do not allow the planners to use creativity 
and experience to detect unforseen difficulties, develop new strategies, 
and examine their effect on the proposed system or program. Sitting 
around a conference table may not always promote the kind of social 
Interchange that Is conducive to good analysis and planning. A special 
use of the simulation exercise normally reserved for Instruction, offers 
a great potential for educational planning. For purposes of this discussion 
it may be referred to simply as a planning exercise. Planning exercises 
have found use in city planning, architecture, and urban development 
(Taylor, 1967; Taylor and Maddlson, 1967, 1968; Feldt, 1966, 1967). 
Strategies for military efforts have been developed using war games. 

It Is only natural that the application of the simulation exercise to 
planning be exploited elsewhere. 

The planning exercise to be described for purposes of illustration 
was conducted for the exercise and evaluation of national— level civil 
defense systems within the context of realistic changes in international 
tension and crisis buildups (Hardlck et al.« 1967). The exercise portrayed 
an environment that simulated the world in which the Office of Civil 
Defense (OCD) exists so that its functions and operations could be intro- 
duced into that environment for purposes of analysis and evaluation. 
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The game allows the OCD to: 

(1) Identify problem areas and alternative courses of action, 
given the initial situation; 

(2) obtain information for further study and analysis; 

(3) investigate alternatives and problem areas by actually 
"playing” them out; 

(A) identify future possible contingencies, important operative 
factors, and probable outcomes that may be overlooked in 
OCD planning; 

(5) Stockpile useful concliisions from various plays and 
recycles of the game: 

(6) test probable Impact of changes in OCD systems; 

(7) Identify weak links in OCD and other governmental agencies; 

(8) provide "analytical guldcposts" for future studies; and 

(9) evauate the Impact of the exegencics of time and events 
on the OCD decision-making process. 

In its simplest form, the game Involves two sides: 

(1) the United States, represented by the Blue National Team 
and the Office of Civil Defense (OCD) Team; and 

(2) the enemy, represented by the Red National Team. 

The OCD Team operates separately as a subordinate staff agency of the 
Blue Team, and furnishes the Blue Team with status reports on civil 
defense activities, advises on civil defense matters, and converts Blue 
civil defense decisions into plans and orders. In a more complex form, 
the game may Involve other nations. 
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A basic scenario provides the framework and background against 
which plans and decisions are made by the participants* In brief, it 
provides the setting for the initiation of game play. Factual data 
present general and special International situations to provide a view 
of the world conflict areas. Summaries are given to each team describing 
their national political and economic posture, their resources, national 
goals, and so forth. In addition, separate intelligence reports defining 
enemy capabilities, limitations, and resources are provided. 

Once the basic scenario is used to project the world situation to 
the starting point of the game, player actions largely determine subsequent 
events and world conditions. A "control" is used to guide the game so it 
does not drift into irrelevant channels that do not meet the game objectives 
The m ai n feature in the game play Is the "estimate of the situation 
prepared by each team. These represent plans or actions derived from logica. 
analysis of the events, and provide a basis for succeeding cycles of 
play when these plans and actions are Implemented to generate international 
tension that precipitates a crisis . "Control" assesses the estimates to 
determine their relevance to game objectives, and their validity with 
respect to diplomatic, political, and military strategies. Succeeding 
cycles provide players an opportunity to Implement the actions projected 
in their Initial estimate, to analyze new situations, to develop alternative 
plans to meet the simulated conditions, and to make further decisions 
regarding their course of action to take. 

Side studies may be used to examine in detail significant facets of 
a civil defense situation not amenable to full development during the 
exercise* Another important feature of the exercise is the capability to 
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retrace the path of the game and to replay it from any desired point 
in order to investigate alternative strategies. 

The post-game evaluation is a crucial part of the planning exercise. 
The game is reviewed to broaden the overview of all players and to provide 
the opportunity for cross fertilication of ideas. It may be decided to 
replay specified situations or to conduct side studies when required. 

Implications for Education 

The sort of exercise described above has been used in planning 
educational systems. Abt (1967) calls the technique a "human-player 
simulation of the planning, programming, and budgeting process." 

Typically, the planning exercises developed by Clark Abt and 
Associates usually run for at least a day or two and involve as many 
as fifty or sixty participants. Simply stated, the exercise is "designed 
to force planners to interact with one another over critical school 
issues and to gain from the feedback, critical Insight into the problems 
of educational planning and the possibilities for solution" (Abt 
Associates, Inc., 1968, p. 7). 

Three variations of the planning exercises have been described in 
detail elsewhere: The Educational System Planning Game (Abt, 1967); the 

PEPEX Educational Planning Simulation (Abt Associates, Inc., 1968); and 
SEPEX - A School Electronics Planning Exercise (Abt Associates, Inc., 1967. 
The Educational System Planning Game involves the participants in a 
gome situation where major issues of education planning, their benefits 
and their costs, are brought into the open and discussed. Players take 
the roles of educators, students, and a special type of person - the 
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"Reality Daemon" whose function It is to personify various social 
problems and pressure groups related to educational planning such as 
Industry, the disadvantaged, the minority groups, parent groups, and so 
forth. Depending on the number of players, there may be two or more 
teams composed of these three groups. The game exercises Educator Teams 
in their educational-system planning skills, and Student and Reality 
Daemon teams In their education— evaluative skills as well as the 
Identification of crucial Issues. The Educator Team that prepares the 
best program, perhaps measured by the quantity and quality of graduates, 
with the given budget, wins. 

The sequence of activities may be summarized as follows: 

(1) The Educator teams formulate policy idille the Student 
teams prepare evaluative criteria for estimating the 
Educator's programs. The Reality Daemons Input to both 
Teams. 

(2) The Educator teams submit their reports for Student team 
evaluation and selection 

(3) The Reality Daemons make adj\istmcnts for Implausible claims, 
and score the evaluations. 

To be sure, the plans produced in a few hours* deliberation are much 
too broad to be directly useful. Yet, It seems evident from this 
writer's experience with the planning game that successive cycles of 
play, perhaps separated by Information-generating activities, may be a 
very real asset to the planning of education systems. In a realistic 
and Intense way. Issues are brought to light, and various strategies of 
meeting these Issues are proposed and evaluated. The Interpersonal 



communications that are elicited in the simulation environment seem to 
have a facilitatlve effect in focusing the problem and bringing to light 
tentative solutions, much more so than in a discussion of the same 
problems around a conference table. An added bonus is that the exercise 
is readily adapted to practically any educational group’s needs, and little 
is required in the way of special facilities or equipment* 

It remains to be seen whether the planning exercise actually does 
result in better program plans consistently as compared with conventional 
techniques. Evidence in the published reports indicate that local 
conditions or inadequacies in previous plays lead to changes in the 
exercise that may or may not represent improvements. Game design questions 
need to be resolved: How con^lete should the briefing be, in terms of 

school district data and information; how precise should roles be 
defined; how much time should be given for the various activities; 
what terminal objective should be stressed (prepare a finished plan vs. 
state problems and suggest solutions); how much game structure should be 
used; how many issues should be predesigned into the game; how much 
role- assuming vs . role-performing behaviors should be used, l.e*, should 
superintendents perform their own role, or another's role; etc. 

In summary, it seems that the planning exercise offers some exciting 
alternatives for constructing programs in the field of education* It 
potential has not been realized. It has even been suggested that 
"ultimately, a planning exercise should be used to assist planners in 
building predictive models of the educational systems for which they 
are planning" (Abt Associates, Inc., 1968). This use of simulation 
should receive much greater attention, both in application and research, 
in the next few years. 
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Industrial Applications 



Many Industries and businesses have grown so rapidly In the last 
decade that training programs for their employees are practically man- 
datory. Personnel shortages In some areas are acute. Management has 
recognized the need for having training programs In order to retain 

talent as well as to upgrade talent. 

Typically, these programs Initially emulate conventional programs 

found In public education. The Immediate problem that faces the vice- 
president In charge of training Is that when managers, employees, and 
businessmen return to the classes, the last thing they want are seminars 
and lectures on fundamental principles and concepts Isolated from a 
functional context. This problem Is easily overcome with the use of 
simulation In the form of the business or management game. 

Business games have historical roots dating back to war games and 
military map exercises (Thomas, 1961 )• In the typical military game, 
two teams given hypothetical missions attempt to accomplish their goals 
by alternately making decisions, having them evaluated by unpires, and 
making further decisions on the basis of the umpires feedback. Often, 
computers are used to calculate the decisions. 

The first practical game for business management was developed In 
1957 by the American Management Association. The Top Management Decision 
Simulation Is now one of hundreds of games that simulate the decision- 
making process of management In various settings ranging from supermarkets 
to unspecified Industries. These games exercise all aspects of management 
Including production, marketing, and Inventory control. While many of 
the games are used In colleges, a wide variety are used In Industry, for 
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example, to help employees practice making decisions in business so 
as to better understand business operation* Such a business simulation 
exercise is Venture « developed by the Proctor and Gamble Company (Proctor 
and Ganble, 1966). In Venture « one or more participants manage coopera- 
tively one of five companies, competing in a single consumer products 
industry* The exercise involves eacdi company in making decisions about 
sudi things as production, costs, research, and marketing, during an 
"operations meeting" and profit allocation during the "profits meeting"* 
Scorers calculate manually the results of each company's decisions after 
each meeting. 

Results are shown In terms of product sales, sales Income and gross 
profit* After the six-period operation, a critique is conducted where 
participants review their objectives, decisions, and results* 

Venture Is geared more for the orientation of company employees to 
business operations than for the training of top management* The Proctor 
and Gamble Company has found It profitable to have employees learn more 
about what business management does* It should be noted that only 
selected parts of the Industry are simulated* Not Included are provisions 
for borrowing capital, for example* The omission reduces complexity 
as well as "serves as a constructive discipline toward participants' 
good management of existing resources." Other management simulations are 
geared for executives* Whatever audience Is targeted, the game Is 
basically similar to the one described. In terms of the decisions required* 
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Implications for Education 

Basically, the business game is a "trlal*and-error method used to 
gain insight into business problems" (Greene, 1960). It may be tised at 
the beginning of a training program to orient or sensitize students, or 
it may be used at the end of the course as a self •evaluative Instrument. 

It can be played over a prolonged period of time, or in a matter of 
hours. It may even be played by mall. Greene (1960) reports of a large 
oil company those men in the field report decisions, and review feedback 
by mall. 

It need not be pointed out that the simulation game may be applied 
in education. It being applied. Literally hundreds of games are 
being used, and have been used in past years with little public recog- 
nition. Its use, in fact, has some of the characteristics of a fad. 

Many Instructors are experimenting with the simulation game with little 
or no gtiidance offered by the game designers. On the surface, it seems 
obvious that the game does possess enormous potential when properly 
applied. It Involves most students actively where other tedmlques fall. 
Most users point out that the novelty and the excitement created by 
simulation are unparalleled In most educational circles. Cherryholmes 
(1966), in his review of six investigations of educational games, con- 
cluded that simulation produced increased student Interest. 

There are those who state that games have severe limitations, and 
are probably overused. Several years ago, the same type of criticism 
was given of business games ( cf . , Roberts, 1962). Mow its the 
educational game's turn to be criticized, and these criticisms are not 
entirely unfounded. There are weakness in business and educational games. 



25 



and their administration. Realism of the game, and ability of the game 
administrator are areas where faults occur. It almost seems that the 
production of games with built-in shortcomings exceeds research on 
how games may be improved. Game design is either looked upon as exceed- 
ingly complicated, and difficult for layman to understand, or it is a 
task handed over to the students themselves. Some point to this latter 
case as being the strongest asset of a game. When students design games, 
they learn about the model and how various components interrelate with 
each other. It’s difficult to justify the building of elaborate guidelines 
for game design by the instructor when it is proposed that games be 
designed by the students themselves. Yet, youngsters may have more 
insight on the "whys" of student designed games than the instructors 
who design games for them. When asked whether he learned more from 
moving pictures or learning games, one junior-high schooler <]uickly 
replied, "Movies. They teach you something. Games are just for fun." 
Perhaps game designers have been too concerned with only the cognitive 
outcomes of the so-called learning games. Perhaps on occasion they 
should settle for affective outcomes that simply keep the potential 
learning drop-out in the system. If a game did just this, it would be 



worth while. 



Innovative Applications 



Televlslon-tledlated Simulation 

Simulation need not be limited to a trainer, a classroom, or a 
series of rooms In which students Interact In teams. One of the most 
unique experiments Involving simulation used home audiences of WGBX-TV, 
a special service UHF ^annel In Boston (Lee, 1967; 1968). In the fall 
of 1967 a 5-proeram simulation game, called The Most Dangerous Game 
was broadcast. It was a fictional-name simulation of the Korean crisis 
of 1950. Studio participants represented statesmen of six major nations 
Involved In the simulated dispute. The home audience took the part of 
the political elite of one of the teams. They advised the statesmen 
throu{^ telephone calls and letters. Further, home viewers Interacted 
with each other and discussed Issues raised In the simulation. 

Roger G. Mastrude of the Foreign Policy Association, with whose 
cooperation the series was developed, summarises the goals of the experi- 
ment. 

'*(1) to enlist a new participating audience not enlisted through 
proper community-organizing efforts; 

(2) to motivate a relatively large audience of Intelligent 

television viewers sufficiently to: (a) Induce them 

to view 8 world affairs program, and (b) Induce them to 
act as participants In simulation by Interpersonal 
discussion and/or by telephone to the station; 

(3) to reshape simulation Into a visual medium (for Its 
normal character as a process wholly constructed for 
the experience of the players tdio enact It); 
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(4) to construct a leamlnC'Sltuatlon fruitfully conblnlng the 
'media* of the simulation exercise, television, discussion, 
and telephone feedbadc; 

(5) to conmunlcate substantive lessons with Important educational 
value for this audience." 

(Lee, 1967, pp. 11-12) 

The results of the experiment have been reported In detail elsewhere 
(Lee, 1967). For purpose of this discussion. It Is sufficient to note 
that audience response was overwhelming. By far the most appealing 
aspect of the program reported by home viewers was "audience participation. 
Slxty-nlne per cent of the audience called the station more than once on 
the last program. It Is also Interesting to note that the majority of 
viewers watched the program (or more accurately, participated In the 
simulation) as family groups or with Informal groups. 

Implication for education . This unique experiment represents a 
most significant wedding of a technique with a medium. There Is little 
doubt the success of The Most Dangerotis Game will not be forgotten. It 
revealed that television audiences need not be passive receptors. The 
exerlment dramatically Illustrated how television can Involve home 
viewers . 

In the experiment, the home audience played the role of advisors to 
one studio team. Clearly, this limitation did not reduce home partici- 
pation involvement. However, the home participants need not be limited 
to an advisory role for only one team. Lee (1968) suggests that the 
simulation might be played In several cities, each city representing 
a country. Through a flexible Interconnected network system, cities 



could break away from the interconnection and broadcast locally to only 
Its own constituents. This, In fact, has nw been done.^ Cabinets 
ISl Crisis . a simulation Involving the 1950 Yugoslau crisis with Russia, 
was played In the Spring of 1968 In three cities— Boston, Philadelphia, 
and Rochester, New York. The studio audience took roles of executives 
while the home audience acted as the legislature who sent bade replies 
to the executives to try to Influence them. It was played for one day 
per wedi for five weeks. This same game has also been played with 
English speaking high school students in Singapore, Kenya, and Chicago. 

1190 of television as a medium for simulation need not be 
limited to International relations and world affairs. VJhat better use 
could be made to Involve all parts of society In an examination of urban 
problems, civil rights, and educational and local Issues. For example. 
In an examination of poverty, could home viewers develop empathy with 
real-life counterparts In such a manner that their behavior would be 
permanently changed? Since television Is so universally watched and 
enjoyed, the Implications of using television, not as an Informatlon- 
imparter, but as a response ellclter, are staggering. VIhat better way 
Is there to unite a family for an evening In a school— related simulation 
In U. S. History, civics, or social problems. Simulation exercises 
need not be limited to class hours In a school room. The day mleht even 
come when periodic simulation specials are conducted over networks In 
prime time spots. 



^Personal communication with Mr. George McClelland, Foreign Policy 



Association. 



situational Response Testing 

In designing the form of a test, an Individual has a number of possi- 
bilities available to him, such as: 

(1) elicit a related behavior that must be Inferred on the basis 
of logical relations; 

(2) elicit *'what I would do" behavior, where the student states 
what action he would take to solve a problem, given a brief 
description of a problem situation; 

(3) elicit lifelike behavior, where the student gives lifelike 
responses In non-real-life (simulated) settings; and 

(4) observe real-life behavior. 

These and others are discussed In detail by Frederlksen, (1962, pp. 323-346). 

Frederlkson states that the "observation of real-life behavior la 
ordinarily not a suitable technique for measurement." (Nor Is It usually 
practical, especially with large groups of learners.) Frederlkson claims 
that the measure that Is "recommended for just consideration In a training 
evaluation study is the type that most closely approximates the real-Ufe 
situation." 

For Illustration, let us examine the work of the American Board of 
Orthopaedic Surgery, who has revolutionised Its In-tralning examination 
with a procedure that simulates the physlclan-patlent encounter (University 
of Illinois, 1967a). The Patient Management Problem test has several 
unique features: 

(1) It presents a simulation problem In patient management 
that carries the examinee through a series of sequential. 



30 






Interdependent decisions representing various stages In the 
diagnostic work-up and management of a patient; 

(2) It provides realistic feedback about the results of each 
decision as a basis for subsequent action, and does not 
allov; the examinee to retract his decision once It Is made; 
and 

(3) It allows both for variations In medical approaches and In 
patient responses appropriate to these several approaches* 

The procedure may be best Illustrated by going through one of the 
problems* For example, one case involves a 62-year old woman idio fell 
and fractured her hip* A mild cardiac failure was detected and controlled* 
The examinee is now asked to specify treatment of the fracture* Pictures 
of the fracture are provided* First of all, the examinee Is asked to 
choose among six alternatives* Should he: (1) Initiate non-operative 

therapy: (2) perform a closed reduction and Internal fixation; (3) perform 
a closed reduction, valgus osteotomy and fixation; (4) perform an open 
reduction and Internal fixation; (5) Insert a prosthetic replacement; 
and (6) remove the femoral head and neck* The examinee Indicates his 
choice by erasing an opaque overlay on an answer sheet to the rl^t of the 
corresponding number of the choice* Suppose he chooses "to perform a 
closed reduction and Internal fixation" and erases the overlay next to 
^370* He Is directed to "Erase Response 445" which reads: 

"After two attempts at reduction. X-rays were obtained* 

(Figures 5 and 6*) Turn to Section IIIE*" 

Section III E asks the examinee If this Is an acceptable or unacceptable 
reduction, on the basis of the X-rays. If he says that It Is acceptable. 
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he eraees the overly next to #397 end Is directed to "Erase Response 
447." 

"You have now fixed the fragments and the patient has 
done well on your Immediate poet-operative regime. She 
has returned after two months complaining of pain In 
Che groin. Upon examination the pain Increases when the 
hip Is mowed In any direction. Turn to Section 111 A." 

Section III A asks what the examinee suspects Is wrong. Suppose he 
taypotheslses that lose of position Is the cause of the pain. Erasing 
the #377 overlay reveals that #450 should be erased. It reads 
"You order an X-ray (Fig. 13) to confirm your suspicion. 

Turn to Section III 1) • *' 

Section III D asks the examinee to advise one of several solutions. If 
he diooses full weight bearing as the treatment, he Is asked to erase 

#389 and #457 consecutively, and reads: 

”In six weeks you receive a letter from another ortho- 
paedic surgeon stating that the patient had consulted 
him because she had severe pain. He found that the 
femoral bead had separated from the femoral nedc and 
he Is doing Indicated reconstructive surgery. END OP 
PROBLEM." 

It is apparent that an unwise decision a few move, back had led 
our future orthopaedic surgeon to strike out. The treatment of full 
wel^t bearing has caused further probUm. resulting In reconstructive 
surgery. His score for this prdblem Is figured by noting the nunfcer 
of errors at falling to select helpful option, a. compared with the 
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number of errors of selecting harmful or ineffective options. Also, 
his score could be expressed in terms of per cent agreement with the 
experts. 

Other examinations employing simulation techniques that have been 
developed for the evaluation of performance in medicine Include simulated 
diagnostic interviews, simulated proposed treatment interviews and 
SiHmulated patient management conferences (Levins and HcGuire, 196S; 

McGuire, 1968; University of Illinois, 1967a; 1967b). These techniques 
all use role-playing techniques, where an examiner is "programed" to 
play the role of a patient. 

Implications for Education 

A most urgent need in educational systems is for the criteria test 
that is given after instruction to accurately reflect the objectives of 
instruction. It is all too obvious that one cannot specify the appropriate 
tediniques for evaluating instructional outcomes until he has a cleat 
idea of what these outcomes are. During the last decade, the emphasis 
on stating objectives in a way that is at least related to observable 
behavior has given impetus to the designing of tests that better assess 
terminal performance on the part of the student. 

In his discussion of situational response tests, Frederiksen uses 
as examples the Medical History test used by some medical schools, the 
In-Basket Test, used in school administrstion courses, the Russell Sage 
Social Relations Test, used to evaluate eleimntary schools with respect 
to their success in teaching "social relations," and the Physical Science 



Study Coimnlttee Physics Test, for high school physics courses* It will 
be noted that there Is more than a passing resemblance of this technique 
with the Trainer-Tester Simulator discussed above* Both Involve an 
Ingenious method of sequencing a number of Interdependent decision- 
points In a realistic manner so that the cognitive skills of decision 
omdclng are exercised or tested* The potential for application In pro- 
fessional education courses, adult education, as well as In public 
schools Is practically unrealized* The use of simulation for performance 
evaluation Is discussed further by Gagne (1954; 1962), Thorndike (1947), 
Gibson (1947), Schalock, et al* (1964), and Bealrd (1967)* 

Summary 

From the examination of the several applications discussed above. 

It Is probably safe to say that simulation Is "coming of age"* The 
"Innovation" of simulation Is not new to education, at least non-pid>Uc 
education* Simulation has been around for years — In the military. 
Industry, and more recently, government* Simulation does not really 
represent a startling new approadi that out -modes all others* It does 
represent a new way of looking at instruction that emphasizes the 
judicious approximation of aspects of real life to create an environment 
for llfe-Uke response on the part of the student* 

How does one assess the status of the field? By the quantity of 
simulations being developed? By the quality of these products? By Its 
wide range of application? This report does not purport to offer evidence 
to determine accurately any of these factors* It Is difficult to even 
estimate hot^ many different simulation exercises have been developed for 
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Instructional uses. This x^rlter estimates that minimally, 300 simulations 
have been developed, and disseminated in one form or another, primarily 
for sdiool use. Prob^ly this number is much higher. It is also 
difficult to assess the quality of these simulations, since objectives 
are not clearly stated in many cases. It is somewhat easier to assess 
the variety of the application. One only need witness the applications 
briefly alluded to in this paper to see its wide use. Slowly, data are 
being accumulated to shoif the learning functions most appropriately 
developed by simulation techniques. In the next ten years, what will be 
learned about simulation will establish a firm data base to guide the 
development and use of the technique in well-founded ways. 
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Kanageaent Gaae L.M. Elsgruben Schools it ion in which two to four dairies are processing 

and marketing fluid mild products. 
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